Next generation user interface for audio video display device such as TV

ABSTRACT

A viewer of an audio video display device (AVDD) and transition from a nine panel graphical user interface (GUI) showing a summary degree of metadata to a six panel GUI showing a higher degree of metadata using a horizontal motion.

This application claims priority to U.S. provisional patent applicationSer. No. 61/473,098, filed Apr. 7, 2011.

FIELD OF THE INVENTION

The present application relates generally to user interfaces (UI) foraudio video display devices (AVDD) such as televisions (TVs).

BACKGROUND OF THE INVENTION

The nature of a dynamic society propels an ever-increasing variety oftastes for forms of entertainment, such as television. Rarely does aviewer find enjoyment in literally every TV program available, and thusthe necessity to hone in on a specific genre in programming emerges. Thecurrent generation of program guides has enabled viewers to rapidlysearch through programs on an increasing number of channels rather than“surfing” by selecting one channel at a time in sequence.

A viewer may never elect to watch a particular program because of apreconceived notion about the nature of the show. For example, a personwith an interest in medicine but a lack thereof in government may chosenot to watch a show involving government agencies involved in themedical industry simply because the show contains a portrayal of agovernment-related issue. The complexity of modern TV programming callsfor a corresponding complex user interface that will help guide theviewer to make a program selection.

SUMMARY OF THE INVENTION

According to principles set forth further below, an audio video displaydevice (AVDD includes a processor and a video display presentingdemanded images under control of the processor. A computer readablestorage medium bearing instructions executable by the processor is alsoincluded. The instructions direct presentation of a first graphical userinterface (GUI) on the display. The first GUI includes a first number ofinformation panels each being associated with respective content thatcan be played on the AVDD. At least some panels in the first GUI presenta summary degree of metadata describing the respective content. Theinstructions executable by the processor also direct the presentation ofa second GUI on the display in response to a viewer motion. The secondGUI includes a second number of information panels each being associatedwith respective content that can be played on the AVDD. Further, thesecond number is fewer than the first number in the first GUI, and atleast some, panels in the second GUI presenting a detailed degree ofmetadata that describes the respective content. The detailed degreeincludes more metadata than the summary degree.

The number of information panels in the first GUI can be nine and thenumber of information panels in the second GUI can be six. The nineinformation panels in the first GUI may be arranged in three rows ofthree and the six information panels in the second GUI may be arrangedin two rows of three. The six panels in the second GUI may alternativelybe arranged in three rows of two.

The latter six panels in the second GUI, presented in response to viewermotion, which can be a horizontal click and drag motion with an inputdevice, can be respectively associated with video content which isassociated with respective panels in two of the three rows of panels inthe first GUI. The two rows of panels in the first GUI that correspondto the panels in the second GUI may be a top row and a middle row ofpanels in the first GUI. All six panels in the second GUI can be largerthan any panel in the first GUI.

In another aspect, a method is disclosed for enabling a viewer of anaudio video display device (AVDD) to transition from a first graphicaluser interface (GUI) showing a summary degree of metadata to a secondGUI showing a higher degree of metadata. The method includes receiving auser motion input, correlating the input to a command to transition tothe second GUI, and responsive to the command, removing the first GUIfrom the AVDD and presenting the second GUI on the AVDD.

In another aspect, an apparatus includes a user input device and adisplay device that receives, signals from the user input devicegenerated by translational motion of a person's hand against the inputdevice. A processor responsive to the first one of the signals changes alevel of metadata presented on the display device from more to lessmetadata, or from less to more metadata.

The details of the present invention, both as to its structure andoperation, can best be understood in reference to the accompanyingdrawings, in which like reference numerals refer to like parts, and inwhich:

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram of a non-limiting example system in accordancewith present principles;

FIG. 2 is a plan view of an example remote control (RC) that may be usedto control the graphical user interfaces (GUI) described herein,schematically showing the processor and wireless transceiver;

FIG. 3 is a screen shot of a nine panel GUI in a summary mode suitablefor gesture control;

FIG. 4 is a screen shot of a nine panel GUI in a fine mode suitable forRC control;

FIG. 5 is a screen shot schematically juxtaposing the RC with thedisplay to show a horizontal click and drag movement on a nine-panel GUIwith a summary level of program metadata; and

FIG. 6 is a screen shot showing that the result of the horizontal clickand drag movement on the nine-panel GUI is a six-panel GUI with a moredetailed level of program metadata.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT

Referring initially to the non-limiting example embodiment shown in FIG.1, a system 10 includes an audio video display device (AVDD) 12 such asa TV including a TV tuner 16 communicating with a TV processor 18accessing a tangible computer readable storage medium 20 such asdisk-based or solid state storage. The TV 12 can output audio on one ormore speakers 22. The TV 12 can receive streaming video from theInternet using a built-in wired or wireless modem 24 communicating withthe processor 18 which may execute a software-implemented browser 26.Video is presented under control of the TV processor 18 on a TV display28 such as but not limited to a high definition TV (HDTV) flat paneldisplay, and may be a touch screen display. User commands to theprocessor 18 may be wirelessly received from a remote control (RC) 30using, e.g., rf or infrared. Audio-video display devices other than a TVmay be used, e.g., smart phones, game consoles, personal digitalorganizers, notebook computers and other types of computers, etc.

TV programming from one or more terrestrial TV broadcast sources 32 asreceived by a terrestrial broadcast antenna 34 which communicates withthe TV 12 may be presented on the display 28 and speakers 22. Theterrestrial broadcast programming may conform to digital ATSC standardsand may carry within it a terrestrial broadcast EPG, although theterrestrial broadcast EPG may be received from alternate sources, e.g.,the Internet via Ethernet, or cable communication link, or satellitecommunication link.

TV programming from a cable TV head end 36 may also be received at theTV for presentation of TV signals on the display 28 and speakers 22.When basic cable only is desired, the cable from the wall typicallycarries TV signals in QAM or NTSC format and is plugged directly intothe “F-type connector” 38 on the TV chassis in the U.S., although theconnector used for this purpose in other countries may vary. Incontrast, when the user has an, extended cable subscription forinstance, the signals from the head end 36 are typically sent through aSTB 40 which may be separate from or integrated within the TV chassisbut in any case which sends HDMI baseband signals to the TV. Other typesof connections may be used, e.g., MOCA, USB, 1394 protocols, DLNA.

Similarly, HDMI baseband signals transmitted from a satellite source 42of TV broadcast signals received by an integrated receiver/decoder (IRD)44 associated with a home satellite dish may be input to the TV 12 forpresentation on the display 28 and speakers 22. Also, streaming videomay be received from the Internet 46 for presentation on the display 28and speakers 22. The streaming video may be received at the computermodem 24 or it may be received at an in-home modem 48 that is externalto the TV 12 and conveyed to the TV 12 over a wired or wireless Ethernetlink and received at an RJ45 or 802.11x antenna on the TV chassis.

Also, in some embodiments a video camera 50, which may be integrated inthe chassis if desired or mounted separately and electrically connectedthereto, may be connected to the processor 18 to provide to theprocessor 18 video images of viewers looking at the display 28.Furthermore, a microphone 52 may be provided on the chassis or separatetherefrom and can be electrically connected to the processor 18 toprovide viewer-generated voice commands to the processor 18.

FIG. 2 shows that an example RC 30 may include a power on key 60 thatcan be toggled to energize and deenergize the AVDD 12. A touch-sensitivepad 62 may be provided against which a user can move his finger tocorrespondingly move a screen cursor on the display 28. Tapping the pad62 can generate a “select” signal, it being understood thatpoint-and-click devices other than the touch sensitive pad 62 may beused.

Also, a back key 64 may be provided to cause the display 28 to go back ascreen shot, i.e., to present the screen shot immediately prior to theone being displayed when the back signal is generated, so as to enable auser to navigate through the various GUIs shown herein. A home key 66may be provided to cause the below-described “home” GUI to be presentedon the display 28, and an options key 68 may be provided to allow a userto cause a list of GUI options to be presented in the display 28. Volumeoutput by the speakers ˜21 of the AVDD 12 can be controlled using avolume up/down rocker key 70. Manipulation of a key or the pad 62 on theRC 30 causes a respective signal to be sent to an RC processor 72 in theRC 30, which transmits the corresponding command to the AVDD 12 using awireless transceiver 74 such as but not limited to an infraredtransceiver. In addition, if desired four arrow keys may be arranged onthe RC 30 to move a cursor up, down, left, and right on the display 28.Also, channel up/down keys may be provided as well as a microphone forvoice input. A full QWERTY keyboard or keypad may be provided ifdesired. The touch pad 62 may be provided with a buzzer or other deviceto generate tactile feedback to the user.

FIGS. 3 and 4 show an example home GUI that may be presented on thedisplay 28 of the AVDD 12. In the embodiment shown in FIG. 3, nineinformation panels arranged as shown in three rows of three panels eachpresent visual content. The panels shown in FIG. 3 are of equal sizewith each other and are rectangular as shown. According to theembodiment shown in FIG. 1, the top left panel 76 of the GUI alwaysshows the currently selected video content, typically either televisedcontent from a selected TV channel or streaming video from a selectedwebsite. Information pertaining to available video content is presentedin the other, eight panels. This information typically includes aphotograph or other image, a content source logo indicating the sourceof the content represented by the panel, and text typically describingthe title of the content and other information.

As shown at 78, a numeral may be provided next to each panel, so thatthe panels may be numbered onscreen from one to nine as shown. Thisfacilitates a user selecting to play video content from a panel bysaying the numeral associated with the panel. Also, as shown at 80 agenre indicator may be presented next to each panel. The genre indicatormay be an arrow in the case of the first panel 76 indicating that thefirst panel 76 is presenting the currently selected video. The genreindicator may be a heart (as shown in FIG. 3 for panel 2) indicating theunderlying video content has been selected by the user as a “favorite”.Other genre indicators may be presented respectively representing“history”, meaning that the content associated with the panel had beenpresented previously, “recommended”, meaning that the content associatedwith the panel is recommended by a recommendation engine executed by theAVDD processor 18, and so on, e.g., “frequently viewed”, “promotionalcontent”. A user can select to present panels associated with content ofonly a single genre.

Additionally, if desired the GUI shown in FIG. 3 may present gesturehints 82, describing in text and/or animated hand motion a gesture andits associated command that the user may make, which can be captured bythe camera 50 and correlated to the respective command by the processor18 executing image recognition software. Further, a menu of selectionsmay be presented as shown along the bottom of the GUI, including a “justfor you” selector 84 to cause the GUI to contain panels with contentpersonalized to a recognized user. A search selector 86 can be selectedto cause a search for a user-input term to be executed. Also, a bookmarkselector 88 can be selected to bookmark the currently playing video inpanel 76 or to bookmark content in a panel over which the screen cursoris positioned.

Still referring to FIG. 3, a settings selector element 90 if selectedcauses a setting menus to be presented to control settings of the GUI. Aqueue selector element 92 may be presented to cause a list of enqueuedprograms to be presented on the display 28, and an inputs selectorelement 94 may be presented, selection of which causes a list ofavailable input sources, e.g., “disk player, cable, satellite” to bepresented, on the display 28. A recommendations selector element 96 maybe presented and if selected causes a list of recommended programming tobe presented on the display 28. The list may be generated by a contentrecommendation engine such as the “Navi” engine made by Sony Corp. A“what's on” selector element 98 may be provided and if selected causes alist of current and future programs such as an electronic program guide(EPG) to be presented on the display 28. Indeed, an EPG may be presentedin one of the panels shown in FIG. 3.

In any case, as mentioned above in the example shown the currentlyselected video content is always presented in the upper left panel 76 ofthe GUI. Should the user select another panel by using the RC 30 or byspeaking the number of the panel or by the appropriate gesture capturedby the camera 50, video content from the source associated with theselected panel automatically replaces the video content which waspresented in the upper left panel 76 prior to receiving the new selectsignal. Indeed, should the user scroll the panels left or right to viewadditional content the upper left panel 76 remains unmoving as the otherpanels move on and off the display 28 as they are replaced by previouslyhidden content panels, with the upper left panel 76 always showing thecurrently selected video program.

The panel layout shown in FIG. 3 is somewhat coarse in that a visibleborder space 100 of many pixels width exists between adjacent panels asshown. Such a coarse representation facilitates control using gestures,although navigation by voice and by use of the RC 30 is alwayspreferably enabled regardless of whether the GUI is in the coarse orfine view. FIG. 4 shows that if the user selects the fine view, theborder space 100 disappears between adjacent panels, a view moresuitable for RC control than gesture control although as stated aboveall three modes of command input (RC, voice, and gesture) remain enabledsimultaneously with each other if desired.

Transition between the two views of FIGS. 3 and 4 may be effected by anappropriate hand gesture (e.g., a vertical motion of the hand) or by anappropriate voice command (e.g., “fine” or “coarse”), or by selecting,using the RC 30, “fine” or “course” from a settings menu accessed byselecting the settings selector element 90 or by pressing a key on theRC 30 or by simply grasping the RC, which is detected by the camera 50and inferred by the processor 18 to correlate to a command to move tothe “fine” screen of FIG. 4. The larger panels in the fine mode of FIG.4 can be used to present more information than is presented in thepanels of FIG. 3.

The GUI shown in FIGS. 3 and 4 may be removed from the screen and thecurrently playing video presented on the full display 28 by, e.g.,toggling the home key on the RC 30. Voice command input may be enabledby voicing a phrase such as “hello TV’, which is detected by themicrophone 52 and using voice recognition software correlated by theprocessor 18 to a command to enable voice commands. Voice input may alsobe enabled using the RC 30 to select the “search” selector element 86.To indicate that voice commands are enabled, an icon such as an image ofa microphone 102 can be presented on the display 28. Gesture commandinput may be enabled by waving the hand, which is detected by the camera50 and using image recognition software correlated by the processor 18to a command to enable gesture commands. To indicate that gesturecommands are enabled, an icon such as an image of a hand 104 can bepresented on the display 28.

Non-limiting examples of corresponding RC, voice, and gesture commandsthat accomplish the same tasks are:

RC COMMAND VOICE COMMAND GESTURE Channel up “Channel up” upward motionof hand Channel down “Channel down” downward motion of hand Volumedecrease “Quieter” thumb down Volume increase “louder” thumb up

FIG. 5 is a simplified rendering of the nine panel GUI of FIG. 3juxtaposed schematically with the RC 30 to illustrate that a horizontalclick and drag operation on the touch pad 62 by a viewer's hand 106 (asbut one example of how a horizontal motion input can be effected) asindicated by the arrow 108 causes a screen cursor 110 to likewise moveright as indicated by the arrow on the display 28, which is interpretedby the processor 18 as a command to transition from the nine panel GUIof FIG. 5 to the six panel GUI of FIG. 6.

In FIGS. 5 and 6, “metadata X” whether in FIG. 5 or 6 refers to metadataconcerning the content “X” represented by the associated panel, while“metadata X+X′” refers to greater metadata, namely, the metadata “X”plus additional metadata X′ associated with the content “X” representedby the associated panel.

With more specificity related to FIGS. 5 and 6, the GUI of FIG. 5includes, in the example shown, nine information panels including thecurrent video window 76 in the upper left hand portion of the display.As discussed above, each panel in FIG. 5 is associated with respectivecontent that can be played on the AVDD. Furthermore, note that thepanels in the GUI of FIG. 5 present a summary degree of metadatadescribing the respective content relative to the degree of metadata ofthe panels in the GUI of FIG. 6. Specifically, the GUI of FIG. 6displays only six information panels as shown, each being larger thanany of the nine panels in FIG. 5 and each being associated withrespective content that can be played on the AVDD. Note further that thepanels in the GUI of FIG. 6 present a detailed degree of metadatadescribing the respective content in that the detailed degree ofmetadata in FIG. 6 includes more metadata than the summary degreepresented by the GUI panels of FIG. 5.

In the example shown in which the GUI of FIG. 5 contains nineinformation panels and the GUI of FIG. 6 contains only six panels, thenine panels can be arranged in three rows of three as shown and the sixpanels of FIG. 6 may be respectively associated with video content whichis associated with respective panels in two and only two rows of panelsin the GUI of FIG. 5. In particular non-limiting embodiments the tworows of panels in the GUI of FIG. 5 that correspond to the panels in theGUI of FIG. 6 are a top row and a middle row of panels in the GUI ofFIG. 5.

While the particular NEXT GENERATION USER INTERFACE FOR AUDIO VIDEODISPLAY DEVICE SUCH AS TV is herein shown and described in detail, it isto be understood that the subject matter which is encompassed by thepresent invention is limited only by the claims.

What is claimed is:
 1. Audio video device (AVD) comprising: processorconfigured for controlling a video display to present demanded images onthe video display under control of the processor; computer readablestorage medium bearing instructions executable by the processor to:present a first graphical user interface (GUI) on the display, the firstGUI including a first number of information panels each being associatedwith respective content that can be played on the AVDD, at least somepanels in the first GUI presenting a summary degree of metadatadescribing the respective content; and responsive to a viewer motioninput while the first GUI is presented, remove the first GUI from thedisplay and present a second GUI on the display the viewer motion notbeing interpreted by the processor as being directed to any particularpanel of the first GUI, the second GUI including a second number ofinformation panels each being associated with respective content thatcan be played on the AVDD, the second number of information panels beingfewer than the first number of information panels in the first GUI, atleast some information panels in the second GUI presenting a detaileddegree of metadata describing the respective content, the detaileddegree including more metadata than the summary degree, wherein thefirst GUI has first, second, and third rows of information panels, thesecond GUI has information panels each corresponding an informationpanel from only first and second rows of information panels of the firstGUI, and the information panels in the first and second rows of thefirst GUI establish the first and second rows of information panels inthe second GUI, the information panels in the second GUI being largerthan corresponding information panels in the first GUI.
 2. The AVD ofclaim 1, wherein the first number is nine.
 3. The AVD of claim 1,wherein the second number is six.
 4. The AVD of claim 1, wherein thefirst number is nine and the nine panels in the first GUI are arrangedin three rows of three, the second number is six, and the six panels inthe second GUI are respectively associated with video content which isassociated with respective panels in two rows of panels in the firstGUI.
 5. The AVD of claim 4, wherein the two rows of panels in the firstGUI that correspond to the panels in the second GUI are a top row and amiddle row of panels in the first GUI.
 6. The AVD of claim 1, whereinall panels in the second GUI are larger than any panel in the first GUI.7. The AVD of claim 1, wherein the viewer motion is a horizontal clickand drag motion on an input device.
 8. A method for enabling a viewer ofan audio video device (AVD) to transition from a first graphical userinterface (GUI) showing a summary degree of metadata to a second GUIshowing a higher degree of metadata, comprising: receiving a user motioninput while the first GUI is presented; correlating the input to acommand to transition to the second GUI; and responsive to the command,removing the first GUI from the AVD and presenting the second GUI on theAVD wherein the first GUI has first, second, and third rows ofinformation panels, the second GUI has information panels each comesondin an information panel from only first and second rows ofinformation panels of the first GUI, and the information panels in thefirst and second rows of the first GUI establish the first and secondrows of information panels in the second GUI, the information panels inthe second GUI being larger than corresponding information panels in thefirst GUI the user motion not being directed to a particular panel ofthe first GUI.
 9. The method of claim 8, wherein the user motion inputis a horizontal motion against an input device.
 10. The method of claim8, wherein the first GUI includes nine information panels arranged inthree rows of three, the second GUI includes six information panelsrespectively associated with video content which is associated withrespective information panels in two rows of information panels in thefirst GUI.
 11. The method of claim 10, wherein the two rows of panels inthe first GUI that correspond to the panels in the second GUI are a toprow and a middle row of panels in the first GUI.
 12. The method of claim8, wherein both GUIs present information panels and all panels in thesecond GUI are larger than any panel in the first GUI.
 13. Apparatus,comprising: user input device; display device receiving signals from theuser input device, at least a first one of which signals is generated bytranslational motion of a person's hand against the input device; andprocessor responsive to the first one of the signals changing a level ofmetadata presented on the display device from more to less metadata, orfrom less to more metadata, a current video pane being presented in anunchanging location on the display device in both levels of metadata;wherein the processor changes the level of metadata by changing from m afirst GUI to a second GUI, and wherein the first GUI has first, second,and third rows of information panels, the second GUI has informationanels each corresponding an information panel from only first and secondrows of information panels of the first GUI and the information panelsin the first and second rows of the first GUI establish the first andsecond rows of information panels in the second GUI, the informationpanels in the second GUI being larger than corresponding informationpanels in the first GUI the motion of the person's hand not beinginterpreted as being directed to a particular panel of the first GUI.14. The apparatus of claim 13, wherein the first GUI includes a firstnumber of information panels each being associated with respectivecontent that can be played on the display device, at least some panelsin the first GUI presenting a summary degree of metadata describing therespective content, and the second GUI includes a second number ofinformation panels each being associated with respective content thatcan be played on the display device, the second number being fewer thanthe first number in the first GUI, at least some panels in the secondGUI presenting a detailed degree of metadata describing the respectivecontent, the detailed degree including more metadata than the summarydegree.
 15. The apparatus of claim 14, wherein the first number is nine.16. The apparatus of claim 14, wherein the second number is six.
 17. Theapparatus of claim 14, wherein the first number is nine and the ninepanels in the first GUI are arranged in three rows of three, the secondnumber is six, and the six panels in the second GUI are respectivelyassociated with video content which is associated with respective panelsin two rows of panels in the first GUI.
 18. The apparatus of claim 17,wherein the two rows of panels in the first GUI that correspond to thepanels in the second GUI are a top row and a middle row of panels in thefirst GUI.